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This paper presents a search for correlation in the 
arrival directions of 2190 neutrino candidate events 
detected in 2007-2008 by the ANTARES telescope, and 
69 ultra-high energy cosmic rays (UHECRs) observed 
by the Pierre Auger Observatory between January 1st 
2004 and December 31st 2009. No significant correla- 
tion was found. The corresponding 90% C.L. upper 
limit on the neutrino flux from each observed UHECR 
direction (assuming an equal flux from all of them and 
for £^ energy spectrum) is 4.99x10 **GeVcm^s '. 



1 Introduction 

The astrophysical sources of uhra-high energy cosmic 
rays (UHECRs) remain unknown. These particles 
are expected to be of extragalactic origin and poten- 
tial sites of acceleration include jets of gamma-ray 



bursts ( Waxman 1995; Vietri' 119951 
[19971; iMurase et al 
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iWaxman & Bahcall 



.2006.) 

^Biermann & Stritt mattej Il987l; 
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. „ .Stecker et al. 
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The 

search for UHECR sources is complicated by their 
deflection in magnetic fields inside and outside of the 
Galaxy and by the extremely low rates of these particles: 
above 10''^eV, about 1 particle per km^ per century. 
Due to their interactions with photons of the cosmic 
microwave backgroun d via the GZK mechanism tareiseni 
19661: IZatsepin & Kuzmin,1966) . UHECRs propagation 



distances are limited, for example for protons, to about 
100 Mpc. While the existence of a cut-off in the energy 
spectrum o f UHECRs, first observed by the HiRes 
experiment dAbbasi et al.l l2008a , l2009l) . has now been 
confirmed by the data of the Pierre Auger Observatory 



([Abraham et alj l2008al [2010*), the composition of the 
cosmic rays above a few 10'**eV, crucial for estimation 
of expected magnetic deflection magnitude, remains 
uncertain. Although data from the Pierre Auger Obser- 
vatory seem to indicate a transition from light to heavier 
composition above 40EeV, this trend is still subject to 
large uncertainties, in particular related to the lack of 
accurate modeling of hadronic interactions in the relevant 
energy domain. 

A new and promising method to study the origin of 
the UHECRs is the multimessenger approach, which is 
based on the detection of secondary fluxes of gamma- 
rays and neutrinos associated with the decay of pions re- 
sulting from the interaction of the UHECRs with mat- 
ter or photon fields in the vicinity of the cosmic ac- 

I II < I — 1 

celerators (Waxman & Bahcall 1999; Bahcall & Waxman| 



1200 1; Becker 2008 ; Becker & Biermann 2009). Although 
gamma-rays have been linked to astrophysical sources 
by recent observations (H.E.S.S., MAGIC, VERITAS, 
Fermi), an unambiguous identification of these sources 
as sites of hadronic acceleration requires the detection 
of the associated neutrino flux. Neutrinos, being neu- 
tral and weakly interacting particles, are neither deflected 
nor attenuated during their propagation from the source 
to the Earth. Their small cross section interaction with 
matter makes their detection challenging and requires 
the construction of very large telescopes. The currently 
operating neutrino telescopes, ANTARES, IceCube and 
BAIKAL, have not yet obse rved any statistically signifi 



cant cosmic neutrino source ( Adrian-Martmez et alj2011 
Abbasi et al.[[201 l[;[Avrorin et al.[[2009[) . 



In this paper, the first source stacking method opti- 
mized for a correlation of arrival directions of UHECRs 
and neutrinos have been developed and applied on the 
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neutrino candidate events detected by the ANTARES tele- 
scope and the UHECR events observed by the Pierre 
Auger Observatory. Would such a correlation be ob- 
served, it would indicate regions of the sky where the 
sources of UHECR and/or neutrinos could plausibly lie, 
as well as shed light both on the UHECR composition 
and on the intensity of magnetic fields in and outside of 
the Galaxy. An observed correlation would also exclude 
the possibility that the dominant sources of UHECRs are 
transient sources, since the time delay between neutrinos 
and protons coming from such a source, is orders of mag- 
nitude larger than the observation time of the ANTARES 
telescope and the Pierre Auger Observatory. 

This paper is organized as follows. The discussion 
about deflection of UHECRs in magnetic fields is pre- 
sented in Section 2. The data samples are presented in 
Section 3 and the background and signal simulations are 
explained in Section 4. The angular search bin optimiza- 
tion and the discovery potential are discussed in Section 5 
and the results are given in Section 6. 

2 Magnetic deflection of UHECRs 

In this paper, ANTARES telescope neutrino candidate 
events directions were correlated with UHECR events 
recorded by the Pierre Auger Observatory, using a source 
stacking method in which the cumulative neutrino sig- 
nal from all UHECR directions is summed and com- 
pared with the expected background. Such an approach 
is known to be sensitive to a significantly lower flux per 
source for a 5 cr 50% discovery potential than the single 
point source approach. A key parameter for the analysis 
is the angular search cone around each UHECR direction 
and is mainly determined by the assumed magnetic de- 
flection of flie UHECRs. 

Protons with the highest energies (above 10'''eV) are 
expected to be deflec ted by the Galactic magnetic field 
up to a few degrees ( StanevI 19971: lAlvarez-Muniz et al 



gles for protons traveling through extragalactic magnetic 
fields, even for a propaga tion through galaxy clusters 



20021: iTakami & Satdl2oTor Medina Tanco et al.l d 19981) 
calculated that protons with en ergies of 4xl ^^eV should 

19991) con- 



Harari et al 



be deflected by about 5° 
eluded that lO^^eV protons arrive to Earth almost un- 
deflected. Deflection angles of about 3°, for proton s 



(Dolagetal. 2005; Koter a & Lemoind 120081; iDas et al 
120081: lAharonian et alj|201oir However, if the composi- 
tion of UHECRs is mostly heavy, identi fication of their 
source s would be likely impossible. Med ina Tanco et al 



(119981) found that Fe nuclei with energy of 2.5xlO^°eV 
can be deflect ed up to 20° in the Galactic magnetic field. 
IProuza & Sm ida (2003) also calculated deflection angles 
of few tens of degrees for heavy UHECRs. Th i s was also 
confirmed in a recent paper by T akami & Sato ( 2010l) . 

In order to avoid the trial factor associated with using 
multiple tolerance windows for the magnetic deflection a 
single value of 3° is adopted for this analysis. 

3 Neutrino and UHECR data 



The ANTARES neutrino telescope dAgeronet al.l20Ill) is 
located in the Mediterranean Sea, 40 km off" the south- 
ern coast of France (42° 48'N, 6° IO'E), at a depth of 
2475 m. It was completed in 2008 and its final config- 
uration is a three-dimensional arra y of photomultiplie rs 
in glass spheres (optical modules dAmram et al.ll2002h ). 
distributed along twelve lines anchored at the sea bottom 
and kept taut by a buoy at the top. Eleven of these detec- 
tion lines contain 25 storeys of triplets of optical modules 
and one contains 20 triplets. The lines are subject to the 
sea currents and can change shape and orientation. A po- 
sitioning system based on hydrophones, compasses and 
tiltmeters is used to monitor the detector geometry with 
an accuracy of 10 cm. The total instrumented volume of 
the ANTARES telescope is about lO^m^. The detection 
principle is based on measuring the Cherenkov light emit- 
ted in the detector by high energy muons, that result from 
neutrino interactions inside or near the instrumented vol- 
ume of the detector. The large background from downgo- 
ing muons produced in cosmic ray air showers is reduced 
by selecting only upgoing muons as neutrino candidates. 

The data acq uisition system of the detector 
(lAguilar et al.l 12007.) is based on the "all-data-to-shore" 



of 4xlO''^eV, were estimated bv lProuza & Smidal (l2003h 
Also, most authors suggested insignificant deflection an 



concept, in which signals from the photomultipliers 
above a given threshold are digitized and sent to shore 
for processing. The absolute time is provided by GPS 
and the precise timing resolution for the recorded 
photo-multiplier tube signals, of order 1 ns, is required 
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to maintain the angular resolution of the telescope. The 
arrival times of the hits are calibrated as described in 
( Aguilar et al. 201 ll) . A LI hit is defined either as a 
high-charge hit, or as hits separated by less than 20 ns 
in optical modules of the same storey. At least five Ll 
hits are required throughout the detector within a time 
window of 2.2 fis, with the relative photon arrival times 
being compatible with the light coming from a relativistic 
particle. Independently, events which have Ll hits on 
two sets of adjacent or next-to-adjacent floors are also 
selected. The physics events are stored on disk for offline 
reconstruction. 

The data used in this analysis were collected between 
Jan 31st, 2007 and Dec 30th 2008. During this time the 
construction of the detector was still in progress. The 
detector consisted of 5 lines for most of 2007 and of 9, 
10 and 12 lines during 2008. For part of that period, the 
data acquisition was interrupted for the connection of new 
lines, and in addition, some periods were excluded due 
to the high bioluminescence-induced optical background. 
The resulting effective live time of the analysis is 304 
days. 

These events were reconstructed offline to determine 
the muon trajectory, using a multi-stage fitting procedure. 
The final stage of this procedure consists of a maximum 
likelihood fit of the measured photon arrival times. A 
quality parameter, indicated by A, is determined based on 
the final value of the likelihood function. Selection cut on 
parameter A >-5.4 has been opti mised in order to have 



the b est point source sensitivity jAdrian-Martmez et al 
201 ih . The estimated angular error obtained from the 



muon track fit is required to be smaller than 1°. The fi- 
nal data sample consists of 2190 up-going neutrino candi- 
date events. For this current analysis, no selection was 
done based on the energy reconstruction. The angular 
resolution was estimated to be 0.5+0.1°. The simula- 
tions indicate that the selected sample contains 60% at- 
mospheric neutrinos, the rest are misreconstructed atmo- 
spheric muons. 

Previously, the Pierre Auger Observatory reported 
an anisotropy in the arrival directions of UHECRs 
([Abraham et al. I l2008bl) and indicated a correlation with 
Active Galactic Nuclei (AGN) from "Veron- Cetty&Veron 
(VCV) catalog ^Veron-Cettv & Veronl2006l) . After a scan 
of the relevant parameters, the prescription was made on a 
subsample of data and the correlation was found to be the 



most significant for a sample of 27 events corresponding 
to cosmic ray energies higher than 57Ee V, falling within a 
bin of size 3.1° around the AGNs from the VCV catalog, 
located at distances smaller than 75Mpc. However, the 
HiRes Collaboration reported an absence of a compara- 
ble correlation in obse rvations in the Northern hemisphere 
dAbbasi et al. 2008bh . Further, the suggested correla- 



tion of the Pierre Auger UHECRs with the nearby AGN 



sources decreased in the following analysis jAbreu et al 



12010 ) with 69 events at energies above 55EeV (lO'''-^'^ 
eV), observed until 3 1 December 2009. These 69 UHECR 
events were used in the correlation analysis presented in 
this paper. 
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Figure 1 : The probability density functions of the number 
of neutrino events in 3-10° bins centered on 69 UHECR 
directions. 



4 Background and signal simulations 

In order to study the statistical significance of any ob- 
served correlation between datasets and determine an op- 
timal angular search bin, Monte Carlo (MC) set with 
10^ pseudo-experiments is generated, each with 2190 
neutrinos and 69 UHECRs. In each of these pseudo- 
experiments the positions of UHECRs are fixed accord- 
ing to the Pierre Auger Observatory dataset and the neu- 
trino background is randomly generated by scrambling 
the 2190 neutrinos from the ANTARES telescope dataset 
in right ascension. The number of neutrinos within an an- 
gular bin of chosen size, centered on 69 UHECR events 
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is counted. The normalized probability density function 
(PDFs) is calculated and fitted with a Gaussian distribu- 
tion, to obtain the mean neutrino count and its standard 
deviation expected from the randomized background sam- 
ples. This procedure is repeated for a range of different 
bin sizes. 
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Figure 2: The mean flux upper limit (90% CL) as a func- 
tion of the search bin size is presented with the red solid 
line. The mean flux upper limit for two times lower angu- 
lar resolution is shown with the blue dashed line. 



For illustration. Figure [T| shows an example count of 
neutrinos for bins of 3-10° size. The count of events is 
done by adding neutrinos in all 69 bins for which the 
minimum angular distance to UHECRs is smaller than 
the bin size. In this way, when the same neutrino event 
falls within multiple bins around the UHECRs, a double 
counting of neutrino events is avoided. After optimizing 
an angular bin size (as described in the next Section), the 
significance of the observed number of neutrino events 
within 69 bins is calculated by comparison with the dis- 
tribution for the pure background MC sample. 

The signal events are simulated assuming a neutrino en- 
ergy spectrum proportional to £ - and equal flux strength 
from each of 69 UHECR directions. Flux values from 
O.SxlO^'^GeVcm^^s"' to lO^^GeVcm^^s"' are consid- 
ered. The flux is converted into signal event rate per 
source using the effective area for 5-12 lines and the cor- 
responding live time. For every source, signal neutrinos 
are generated according to the Poisson distribution with 



the event rate per source as mean value. For example, a 
flux value of lO^'^GeVcm^^s"', gives 0.85 signal neutri- 
nos per UHECR source, or about 58 events for all stacked 
sources. Signal neutrinos are randomly generated accord- 
ing to a Gaussian which is a result of a convolution of 
the magnetic field tolerance window of 3° and the angular 
resolution of the ANTARES telescope. The same amount 
of background neutrinos is removed from a declination 
band of 10° centered on each UHECR to ensure that ev- 
ery random sky has 2190 events and to keep the neutrino 
declination distribution profile close to the observed pro- 
file. 

5 Angular search bin optimization and dis- 
covery potential 

Monte Carlo predictions are used to calculate the 
mean upper limit, or F eldman-Cousins sens itivity 



dFeldman & CousinsI Il998l: iHiU & Rawliiisl l2003b . that 
would be observed over the set of pseudo-experiments 
with expected background rih and no true signal. Over 
an ensemble of experiments with no true signal, the back- 
ground rih will fluctuate to different values with different 
Poisson probabilities, each one associated with an upper 
limit figo. The mean upper limit is the sum of these ex- 
pected upper limits, weighted by their Poisson probabil- 
ity of occurrence. Over an ensemble of identical experi- 
ments, the strongest constraint on the expected signal flux 
corresponds to a set of cuts that minimizes the model re- 
jection factor (yU9()/«j) and at the same time minimizes the 
mean flux upper limit that would be obtained over the hy- 
pothetical experimental ensemble. The model rejection 
factor, as well as the optimized bin size, do not depend on 
a chosen flux value, as both figo and Mj are proportional to 
it. 

The described Feldman-Cousin's approach with the 
Rolke extension (RoUce et al.. 2005i) was used to calculate 
the mean upper limit on the neutrino flux per source as- 
suming that the neutrino spectrum follows E^^, for a 90% 
confidence level, from background samples as shown in 
Figure |2] (red solid line). Using 3° magnetic deflection 
tolerance value, the angular search bin that minimizes the 
flux upper limit is 4.9°. 

With the angular search bin size optimized and fixed, 
it is possible to estimate the probability of making a 3 cr 



4 



or a 5 0" 90% C.L. discovery given a certain signal flux. 
First, the neutrino count necessary for a chosen cr level 
is determined from the background MC samples. Then, 
the number of pseudo-experiments with signal, that have 
more neutrinos in 69 optimized bins than the chosen cr 
level from background only, is counted and this gives a 
direct measure of the discovery potential for that partic- 
ular flux. Figure [3] shows the discovery potential for 5cr 
(red solid line) and 3cr (red long-dashed line) discovery, 
for an optimized bin size of 4.9°. Around 125 (75) signal 
events correlated to the 69 UHECRs directions are needed 
for a 5cr (3cr) discovery in 50% of trials. This counts cor- 
respond to flux per source of 2.16x10"'^ GeV cm"^ s"' 
and 1.29x10"** GeV cm"^ s"' respectively. 




250 



Number of signal neutrinos 

Figure 3: The discovery potential at 3 cr (red long-dashed 
line) and 5 cr (red solid line) 90% C.L. as a function of the 
number of neutrino signal events from 69 sources on the 
whole sky. The discovery potential for two times lower 
angular resolution is shown with the blue dashed line. 

To check the efifect of a possible angular resolution sys- 
tematic error on sensitivity and discovery potential, MC 
simulations with an angular resolution lowered by a fac- 
tor of 2 were performed. The optimized bin value in this 
case is 5.5°, compared with 4.9° obtained from the ob- 
served angular resolution. This 100% larger angular res- 
olution results in about 20% higher neutrino flux upper 
limit. No significant effect is found on the discovery po- 
tential. Figures 12] and |3] show respectively optimized bin 
and discovery potential for observed and 2 times lower 



90° 




-90° 



Figure 4: On this skymap in Galactic coordinates, neu- 
trino events are represented with black dots and angular 
search bins of 4.9° centered on the observed UHECRs 
with black circles. 



angular resolution. Note that the expected error on the 
angular resolution, as we already mentioned, is estimated 
to be much smaller (0.1°). 



6 Results 

To analyze the level of correlation between the distribu- 
tion of 2190 neutrino candidates observed by ANTARES 
telescope, and 69 UHECRs reported by the Pierre Auger 
Observatory, neutrino candidate events were unblinded. 
The significance of an observed correlation is determined 
with the help of randomized background samples, using 
the optimized bin of 4.9°. The most probable count for 
this optimized bin size, or the mean background expecta- 
tion from the randomized samples, is 310.5 events (in all 
69 bins), with the standard deviation of 15.2 events. Af- 
ter unblinding 2190 ANTARES telescope neutrino candi- 
date events, a count of 290 events within 69 bins is ob- 
tained (Figure HI, which is sligtly lower than expected. 
This count is compatible with a underfluctuation of the 
background, with a significance of 1.4 cr. The cor- 
responding 90% C.L. upper limit on the neutrino flux 
from each observed UHECR direction (assuming an equal 
flux from all of them and for energy spectrum) is 
4.99xlO-^GeVcm-2s-i. 
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